Delayed Reinforcement, Fuzzy Q-Learning and Fuzzy Logic Controllers
نویسنده
چکیده
In this paper, we discuss situations arising with reinforcement learning algorithms, when the reinforcement is delayed. The decision to consider delayed reinforcement is typical in many applications, and we discuss some motivations for it. Then, we summarize Q-Learning, a popular algorithm to deal with delayed reinforcement, and its recent extensions to use it to learn fuzzy logic structures (Fuzzy Q-Learning). Moreover, we present how a reinforcement learning algorithm we have developed in the past (ELF Evolutionary Learning of Fuzzy rules) implements an extension of the popular Q-Learning algorithm for the distribution of delayed reinforcement when the controller to be learnt is a Fuzzy Logic Controller (FLC). Finally, we present some examples of the application of ELF to learning FLCs that implement behaviors for an autonomous agent.
منابع مشابه
Mobile Robot Navigation Using Dynamic Fuzzy Q-learning
Fuzzy logic is a mathematical approach towards the human way of thinking and learning. Based on if-then rules, we can design fuzzy controllers with the intuitive experience of human beings. However, it is not practical for a designer to find necessary number of rules and determine appropriate parameters by hand. Hence, we incorporate a reinforcement learning method with basic fuzzy rules so tha...
متن کاملThe Fuzzy Sars’a’(λ) Learning Approach Applied to a Strategic Route Learning Robot Behaviour
This paper presents a novel Fuzzy Sarsa(λ) Learning (FSλL) approach applied to a strategic route leaning task of a mobile robot. FSλL is a hybrid architecture that combines Reinforcement Learning and Fuzzy Logic control. The Sarsa(λ) Learning algorithm is used to tune the rule-base of a Fuzzy Logic controller which has been tested in a route learning task. The robot explores its environment usi...
متن کاملReinforcement learning based feedback control of tumor growth by limiting maximum chemo-drug dose using fuzzy logic
In this paper, a model-free reinforcement learning-based controller is designed to extract a treatment protocol because the design of a model-based controller is complex due to the highly nonlinear dynamics of cancer. The Q-learning algorithm is used to develop an optimal controller for cancer chemotherapy drug dosing. In the Q-learning algorithm, each entry of the Q-table is updated using data...
متن کامل:Learning Fuzzy Logic Controller for Reactive Robot Behaviours
F u x y logic plays an imporrant role in the design of reactive robor behaviours. This paper presents o learning approach IO the development of a fuzzy logic controller, based on the delaved rewards from the real world. The delayed rewards are apportioned to the individual fuzzy rules by using reinfarcement Q-learning. The efficient exploration of a solution space is one of the key issues in th...
متن کاملMini/Micro-Grid Adaptive Voltage and Frequency Stability Enhancement Using Q-learning Mechanism
This paper develops an adaptive control method for controlling frequency and voltage of an islanded mini/micro grid (M/µG) using reinforcement learning method. Reinforcement learning (RL) is one of the branches of the machine learning, which is the main solution method of Markov decision process (MDPs). Among the several solution methods of RL, the Q-learning method is used for solving RL in th...
متن کامل